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Introduction 

Emerging  teehnologies  and  inereasing  requirements 
for  preeision  strike  have  ehanged  the  faee  of  modern 
warfare.  As  the  speed  of  eommand  and  the  amount  of 
information  inereases,  eleetronie  and  digital  proeesses 
must  replaee  manual  information  gathering  and  time- 
eonsuming  data  analysis.  In  order  to  maintain  a 
eompetitive  edge,  the  relevant  information  needs  to  be 
automatieally  proeessed  and  tailored  in  a  way  that  allows 
the  warfighter’s  “situation  awareness”  and  foreeasters’ 
mental  model  of  the  battle  spaee  to  keep  paee  with  eaeh 
other.  This  is  essentially  workflow  automation  whieh 
eliminates  the  busy  data  request/retrieval  work,  yet 
maintains  the  human  in  the  deeision-making  proeess. 

The  EVIS  projeet  is  developing  and  evaluating  a 
prototype  visualization  eapability  for  air  strike  and 
amphibious  warfare  operations  that  delivers  taetieally 
relevant  meteorology  and  oeeanographie  information  to 
foreeasters  and  warfighters,  ineluding  environmental 
effeets  on  sensors  and  weapons.  This  eapability  has 
been  derived  from  an  information  interaetion  model, 
whieh  is  a  deseription  of  the  information  delivery 
requirements  of  warfighters.  The  model  is  based  on 
eognitive  and  systems  analyses  of  workflow  and 
visualization  proeesses  at  shore  and  ship  faeilities. 

Background 

The  EVIS  projeet  is  a  eollaborative  effort  among  the 
Naval  Researeh  Eaboratory,  the  Naval  Undersea  Warfare 
Center,  Newport,  SPAWAR  System  Center,  and  the 
Applied  Physies  Eaboratory,  University  of  Washington. 
The  EVIS  team  is  multidiseiplinary,  and  ineludes 
physieal  seientists,  eomputer  seientists,  and  human 
faetors  psyehologists. 

The  EVIS  projeet  evolved  from  an  ONR- funded,  6.2 
researeh  projeet  that  investigated  the  human  systems 
eomponent  of  the  Naval  meteorology  and  oeeanography 
(METOC)  eommunity.  Researehers  studied  several 
eomponents  of  the  foreeasting  system:  gathering  the 
necessary  METOC  data  and  information  from  both 
numerical  forecast _ 
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models  and  observations;  processing  that  information; 
forming  a  mental  model  of  the  weather;  and  providing  an 
external  explanation  of  the  weather  or  the  ocean’s  effect 
on  a  warfighter’s  mission.  From  this  research  an  applied 
project  was  developed  to  help  solve  some  of  the 
problems  noted. 

A  recent  Ocean  Studies  Board  report  on  the  need  for 
METOC  information  (National  Research  Council,  2003) 
defined  the  issues  that  need  further  research  and 
development: 

•  ensure  that  environmental  information  is 
presented  in  a  manner  that  conveys  to  the 
warfighter  an  appropriate  level  of  confidence  in 
its  content; 

•  ensure  that  efforts  to  enhance  environmental 
information  are  carried  out  in  a  cost-effective 
manner  that  maximizes  resources;  and 

•  create  a  system  for  information  exchange  that 
allows  a  high  degree  of  informed  involvement 
by  warfighters. 

The  information  that  EVIS  project’s  prototype  needs 
to  deliver  must  include  the  effects  of  the  atmosphere  and 
ocean  on  critical  mission  areas  plus  the  effects  on 
sensors  and  weapon  systems.  In  addition,  it  is  essential 
that  the  METOC  information  be  delivered  with  the 
correct  spatial  and  temporal  granularity  needed  to  affect 
successful  decision  making. 


Figure  1.  Forecasters  Task  and  Artifact  Usage  (in 
percentage) 


A  central  tenet  of  the  EVIS  project  has  been  to  focus 
first  on  understanding  the  human  in  the  decision  system. 
Researchers  analyzed  the  observations  collected  from 
locations  where  the  METOC  products  are  made  and 
used.  Four  separate  experiments  had  been  conducted, 
either  ashore  or  at  sea  on  the  USS  Carl  Vinson  (CVN- 
70). 

One  of  the  areas  studied  was  the  tools  forecasters 
used  in  the  process  of  providing  tailored  METOC 
information.  Forecasters  were  observed  as  they 
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developed  the  METOC  produets  needed  for  a  simulated 
air-strike  seenario.  Figure  1  shows  the  kind  of 
information  that  ean  be  derived  from  an  analysis  of 
foreeaster  workflow. 

The  most  important  observations  made  during  this 
initial  human  systems  researeh  eame  during  the  at-sea 
period  spent  on  the  Carl  Vinson.  The  METOC 
personnel  on  Carl  Vinson  made  a  daily  produet  that  used 
pre-defined  rules  to  generate  a  METOC  threshold 
matrix.  This  spreadsheet-like  matrix  listed  a  series  of 
missions  and  systems  affeeted  by  weather,  and  ineluded 
eolor-eoded  eells  in  eolumns  of  progressing  time  ehange. 
Eaeh  eell  was  also  hyperlinked  to  a  METOC  graphie. 
The  produet  was  shared  among  the  units  in  the  Carl 
Vinson ’s  battle  group  via  an  intranet  site. 

It  was  observed  that  while  the  produet  was  well 
reeeived  by  the  deeision  makers  who  used  it,  it  was  a 
time  eonsuming  and  eomplex  produet  to  make.  (During 
the  Carl  Vinson’s  2001  deployment  a  variant  of  this 
produet  was  provided  to  the  Knowledge  Web,  an  html- 
based  information  exehange  system  that  was  put  to 
exeellent  use  during  Operation  Enduring  Freedom 
(Majeranowski,  2003).) 

The  EVIS  team  was  interested  in  the  threshold 
matrix  produet  beeause  the  use  of  rules  seemed  to  help 
foreeasters  organize  their  eomplex  workflow.  The 
produet  also  helped  deeision-makers  quiekly  assess 
weather  impaets  and  allowed  them  to  investigate  beyond 
a  simple  green/yellow/red  eolor-eoding  when  they 
needed  a  higher  level  of  detail  (through  the  inspeetion  of 
the  hyperlinked  METOC  graphie). 

The  EVIS  team  deeided  to  investigate  how  the  use 
of  rules  helps  foreeasters  and  deeision  makers,  and  then 
from  that  knowledge  develop  a  prototype  tool  to  speed 
and  improve  the  proeessing  of  METOC  rules. 

METOC  Rule  and  Rule  Services 

In  the  eontext  deseribed  here,  rules  are  typieally 
environmental  limits  for  military  weapon  systems  or 
operations.  For  example,  a  partieular  weapon  sensor 
may  have  a  maximum  rain  rate  in  whieh  it  ean 
sueeessfully  operate.  A  mission  sueh  as  seareh  and 
reseue  may  be  halted  if  winds  reaeh  a  eertain  magnitude. 

Rules  provide  a  foundation  and  a  eommon 
framework  for  people.  Rules  ean  also  be  flexible  and 
ean  be  adapted  to  ehanging  eireumstanees.  Weapon 
systems  and  operations  have  defined  environmental  rules 
set  in  doetrine  and  manuals,  but  foreeasters  may  need  to 
ehange  a  pre-defmed  rule  or  threshold  when  they  reeeive 
feedbaek  from  a  eustomer  who  requests  different 
thresholding  limitations. 

Rules  ean  help  those  with  limited  expertise  in 
METOC  foreeasting  for  military  operations.  The  rules 
represent  a  eodifieation  of  weather  effeets  experienee. 


Their  use  ensures  a  base-line  eonsisteney,  whieh  ean 
then  be  improved  upon  with  additional  training  and 
experienee. 

Rules  are  also  essential  for  automated  systems.  A 
system  ean  be  designed  to  run  rules  against 
environmental  data  and  provide  foreeasters  with  mueh 
more  weather-effeets  information  than  the  foreeasters 
ean  produee  on  their  own. 

EVIS  System  Architecture 

The  EVIS  team  has  developed  a  prototype  system 
that  ean  provide  rule  serviees  over  the  Navy  enterprise. 
This  development  has  utilized  human-eentered  and 
mission-relevant  design  to  ensure  that  the  eapability  will 
be  usable  and  have  immediate  military  applieation. 
Human-eentered  design  involves  task  and  workflow 
analyses  to  determine  user  interfaee  and  interaetion 
requirements,  and  the  timelines  needed  by  eustomer 
produets  to  ensure  that  the  final  eapability  yields  the 
most  aeeurate  foreeasts  in  the  time  available  for  any 
operational  deeision.  In  the  initial  phases  of  the  researeh 
the  design  was  foeused  on  support  for  strike  mission 
foreeasting  researeh. 

The  goal  was  to  develop  a  eapability  that  will  enable 
foreeasters  to  produee  mission-based  visualizations  and 
produets  in  a  timely  manner  well  within  the  taetieal 
eommander's  deeision  eyele.  The  eapability  will  support 
the  assessment  of  alternative  Courses  of  Aetion  (CO As). 


User  Facing  Seivices 


Figure  2.  EVIS  Serviees  Coneept  Diagram 

The  figure  above  (figure  2)  outlines  an  overview  of 
the  workflow  for  one  type  of  EVIS  serviee  (whieh  will 
be  explained  later  in  this  paper).  EVIS  eurrently  draws 
METOC  data  from  the  Navy’s  Taetieal  Environmental 
Database  System  (TEDS),  and  in  the  future  it  will  utilize 
the  web  serviees  version  ealled  TED  Serviees.  This  data 
is  eataloged  on  the  EVIS  Data  Faeing  System  (or  what  is 
also  known  as  a  server).  Only  those  data  needed  by 
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known  rules  are  made  available  on  EVIS.  New  rules  or 
new  parameters  needed  by  the  rules  require  human 
intervention.  In  the  EVIS  eoneept  of  operations,  this 
would  be  handled  at  the  METOC  foreeast  eenters,  or  in 
the  future  TED  Serviees  might  handle  it  automatieally. 

The  EVIS  Data  Faeing  System  is  responsible  for  a 
variety  of  aetions,  as  deseribed  in  figure  3.  It  ean  reeeive 
requests  from  multiple  applieations,  or  in  the  new 
terminology,  User  Faeing  Serviees,  and  provide  data  to 
different  types  of  rule-based  systems.  At  the  present 
time  there  are  two  EVIS  data  faeing  systems,  one  at  the 
University  of  Washington  and  the  other  at  the  Naval 
Researeh  Eab  in  Monterey. 


Server  Lifo: 


XML  Schemas 


•  Apache  Web  Server 


Maintain  Catalog 

Authenticate  Users 

Paise  Ghent 
Messages 

Provide  Maps 

Exhact  Data  as 
Defined  by  Users 

Tlueshold 

Analysis 

Pubhsh  Output 
Aicliive  Output 


Giid  Points 
Exceeding 
Tluesholds 


Image 

Generation 


Figure  3.  EVIS  Data  Faeing  System  Arehiteeture 


One  of  the  important  design  features  of  the  EVIS 
system  arehiteeture  is  the  use  of  XME  for  all  serviees- 
related  eommunieations  aeross  the  network.  A  sehema 
was  written  that  handles:  rule  definition;  rule  tailoring; 
data  thresholding;  and  delivery  of  overlays  of  geographie 
maps  that  display  the  threshold  information. 


Example  of  an  EVIS  Application 

The  EVIS  Mission  Effeets  Serviees  (EMES)  is  an 
example  of  an  EVIS  web  serviee.  It  provides  a  user 
interfaee  for  rule  generation,  and  allows  the  user  to 
request  environmental  thresholding  for  a  user-defined  set 
of  METOC  limits. 

1.  EMES  Start-Up 

The  EMES  interfaee  is  written  in  Java  and  utilizes 
Java  Web  Start  teehnology.  First  time  users  of  EMES 
would  open  a  session  with  the  data  faeing  system  via  a 
web  browser.  They  then  download  the  EMES  interfaee. 
Past  users  have  ean  have  the  interfaee  resident  on  their 
eomputer;  during  start-up,  Java  Web  Start  eheeks  to  see 
if  the  eomputer  has  the  most  up-to-date  version  of  the 


interfaee.  After  login  formalities  are  eompleted  the  user 
ean  seleet  the  appropriate  data  faeing  system.  The  user 
then  starts  an  EMES  session. 


Figure  4.  Area  of  Interest  Seleetion 

2.  Area  of  Interest  Seleetion 

In  this  task  window  (figure  4),  the  users  are 
provided  a  series  of  thumbnails  that  represent  the 
different  model  data  sets  EVIS  has  available  to  run 
METOC  rules.  User  ean  diseover  additional  information 
sueh  as  the  resolution  of  the  model  and  its  domain 
eoverage. 

Users  then  seleet  the  thumbnail  for  their  area  of 
interest  and  ean  refine  their  geographie  window  with  a 
zoom  eontrol.  They  ean  also  seleet  the  speeifie  model 
run  and  foreeast  times  on  whieh  their  rules  will  be  run. 

3.  Rule  Seleetions  and  Tailoring 

The  Rule  Seleetion  panel  eonsists  of  three  sub 
panels  (figure  5).  The  loaded  rules  (by  default,  the  "air 
strike  rules")  and  their  direetory  tree  are  displayed  in  the 
upper  left  panel.  Other  ehoiees  and  loeations  for  rules 
are  displayed  in  the  lower  left  panel.  The  eurrent  rule  set 
is  displayed  in  table  (spreadsheet)  format  in  the  right 
panel 

The  displayed  rule  set  lists  rule  numbers,  mission 
type,  operation,  evolution,  environmental  parameter  of 
interest,  and  marginal  and  severe  impaet  thresholds  for 
the  speeifie  environmental  parameter  with  respeet  to  the 
mission  eontext  (mission,  operation,  evolution). 
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Loaded  Rule  Set 

□  Loaded  rule  set 
<?  (I3  resources/RuleSets 

Q  airRules.xml 

Rule  Editing  Table  - 

1 

MISSION 

AIR 

OPERATION 
AERIAL  REF... 

ETOLUnOH 

ALL  LEVELS 

PARAMETER 
Surface  Visibility 

1600.0-4800.0M 

4-»f 

SEVERE 

<1600.0M 

5 

AIR 

AIR  BASE 

LAUNCH/R... 

Surface  Visibility 

1600.0-4800.0M 

«1600.0M 

6 

AIR 

AIR  BASE 

LAUNCHfR... 

Cloud  Ceiling 

1000.0-3000.0... 

j!=tJ 

<1  OOO.OFT 

7 

AIR 

ATTACK 

CLOSE  AIR ... 

Cloud  Celling 

1000.0-3000.0... 

<1  OOO.OFT 

8 

AIR 

ATTACK 

CLOSE  AIR ... 

Surface  Visibility 

1600.0-4800.0M 

<1600.0M 

10 

AIR 

BOMBING 

LOWLVL+5... 

Cloud  Celling 

500.0-1  OOO.OFT 

«500.0FT 

11 

AIR 

BOMBING 

LOW  LVL  +5... 

Surface  Visibility 

4800.0-5600.0M 

4-E| 

<4800.0M 

12 

AIR 

BOMBING 

LOWLVL+5... 

Mid -Low  Clou... 

0.0-50.0% 

Jt±j 

>50.0% 

13 

AIR 

BOMBING 

LOW  LVL 

Low-LowClo... 

0.0-50.0% 

j=d 

>50.0% 

14 

AIR 

BOMBING 

MID-HI  LEVEL 

High -Low  Clo... 

40.0-60.0% 

2t±J 

>60.0% 

15 

AIR 

RECON 

GROUND  L... 

Surface  Visibility 

1000.0-3000.0M 

4— ►! 

<1000.0M 

16 

AIR 

RECON 

HIGH  LEVEL 

Very  High  -  Lo... 

50.0-60.0% 

jt±j 

>60.0% 

1  Save  II  Save  As...  | 

17 

AIR 

RECON 

HIGH  LEVEL 

Surface  Visibility 

4800.0-5600.0M 

jt±i 

<4800.0M 

18 

AIR 

RECON 

LOW  LEVEL 

Cloud  Celling 

1000.0-3000.0... 

♦-♦1 

<1  OOO.OFT 

Available  Rule  Sets  . 

AIR 

RECON 

UAV(DRON... 

Cloud  Celling 

4000.0-6000.0... 

4-E| 

<4000.0FT 

□  All  rule  sets 
<?  □  Downloaded  rule  sets 
<?  □  resourcesIRuleSets 

D  airRules.xml 

Q  Local  rule  sets 

I  20 

AIR 

RECON 

UAV(DRON... 

Surface  Visibility 

4800.0-5600.0M 

<4800.0M 

23 

AIR 

RECON 

UAV(DRON... 

Total  Precipitat... 

0.1-0.3IN/HR 

>0.3IN/HR 

'43 

C4ISR 

HIGHALTIT... 

ISR 

Very  High  -  Lo... 

40.0-60.0% 

J=ii 

>60.0% 

52 

SURFACE 

CARRIER 

FLTOPS 

Surface  Visibility 

1600.0-4800.0M 

J=±J 

<1600.0M 

53 

SURFACE 

CARRIER 

FLTOPS 

Cloud  Celling 

1000.0-3000.0... 

Jt±] 

<1  OOO.OFT 

54 

SURFACE 

CARRIER 

FLTOPS 

2  MeterTempe... 

280.0-300.0KE... 

>300.0KELV... 

11  AIR  - -  RECON  UAV(DRON...  20  Meter  Wind  ...  40.0-60.0Kr 

|g  SURFACE  CARRIER  FLTOPS  Significant  Wav...  9.0-1 2.0Meters 

i  SURFACE  CARRIER  FLTOPS  20  Meter  Wind  ...  25.0-35.0Kr 

s 

>60.0Kr 
>1 2.0Meters 
>35.0Kr 

Load  II  Import...  ||  Delete  | 

Figure  5.  Rule  seleetion  and  tailoring 


The  thresholds  are  editable  by  mousing  on  the 
double-headed  arrow  in  between  the  MARGINAL  and 
SEVERE  threshold  values  (figure  6).  The  slider  adjusts 
the  values,  or  the  user  ean  manually  enter  the  eorreet 
value  in  the  appropriate  text  box. 


Figure  6.  Modify  Threshold  Values 

Displayed  rules  whose  parameter  types  are 
unavailable  will  appear  grayed  out  and  at  the  bottom  of 
the  list.  They  may  still  be  ineluded  in  the  seleeted  rule 
set,  but  no  model  data  will  be  returned  for  that  rule  from 
the  request. 

Users  may  seleet  rules  from  a  default  rule  set,  or 
may  load  a  previously  saved  rule  set  from  the  “Available 
Rule  Sets.”  Rules  may  be  seleeted  from  the  displayed 
rule  set  by  eliek,  shift-eliek,  or  eliek-and-drag  mouse 
movements.  A  right  mouse  eliek  then  offers  the 
opportunity  to  delete  the  seleeted  rules  or  restore  rules 
that  have  been  inadvertently  deleted.  The  rules  that  are 
not  removed  from  the  spreadsheet  beeome  the  list  of 
rules  to  send  to  the  server. 


Rule  sets  may  be  named  and  saved  by  either  a  right 
mouse  eliek  or  the  "Save  As...”  button  on  the  "Eoaded 
Rule  Set”  sub  panel.  Onee  users  are  satisfied  with  the 
ehosen  rule  set  (and  possibly  have  saved  it  for  later 
reeall),  they  press  ’’Next”  and  "Confirm  Choiees  and 
Submit  Request”  appears  on  the  sereen. 

4.  Rule  Responses  and  Produet  Tailoring 

During  the  period  between  the  time  the  user  submits 
the  rule  request  and  reeeives  a  reply,  the  data  faeing 
system  runs  all  the  requested  rules  for  the  threshold 
limits  and  generates  threshold  overlays  tied  to  the  user- 
defined  geographie  zoom  area.  Figure  7  is  an  example 
of  the  reply. 

Holding  the  mouse  over  a  foreeast  time  eell 
produees  a  tooltip  indieating  the  number  of  model  grid 
points  and  the  number  of  those  points  whose  value 
exeeeded  the  marginal  and  severe  thresholds.  The  aetual 
thresholded  and  eontoured  image  (eontoured  intervals 
based  on  the  marginal  and  severe  thresholds  in  the 
respeetive  rule)  appears  on  top  of  the  base  map  when  the 
user  elieks  on  the  eorresponding  eolor-eoded  eell. 


Figure  7.  Threshold  produet  tailoring 

Even  though  a  foreeast  time  for  a  partieular  rule 
might  be  red,  it  does  not  neeessarily  mean  that  the 
mission  eomponent  eannot  be  earried  out.  This  is  an 
example  of  the  need  for  the  foreeaster  in  the  loop  to 
assure  a  quality  foreeast.  Depending  on  the  eontext  for 
the  operation,  the  area  of  the  map  where  severe  threshold 
values  are  exeeeded  may  be  very  small  or  in  a  region 
some  distanee  from  the  eenter  of  the  operation  (e.g., 
loeation  of  a  earrier  during  launeh  or  reeovery).  This 
may  be  a  reason  to  ehange  the  eolor  of  a  foreeast  time 
eell  and/or  make  notations  on  the  threshold  image  itself 
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The  forecast  cell  colors  may  be  edited  by  selecting 
the  cell  (an  outline  will  appear  around  the  border)  then 
right  clicking,  which  will  display  a  color  selection  box. 
Clicking  on  a  color  in  the  box  will  cause  the  cell  to 
change  to  that  color.  An  ’’X"  will  appear  in  the  changed 
cell  to  indicate  that  some  change  has  been  made  from  the 
initial  values.  The  original  cell  color  may  be  reset 
similarly  by  choosing  "Reset  Color." 

5.  Mission  Effects  Product  Generation 

Once  users  have  completed  tailoring  of  the  final 
product,  they  can  publish  it  as  an  XML  representation  of 
an  Excel  spreadsheet  (figure  8).  Since  this  output  is  in 
XML,  it  is  envisioned  that  EMES  will  create  additional 
exports  such  as  a  Java  Server  page  or  a  Power  Point  file 
(output  in  other  representations  is  based  on  their  schema 
descriptions). 


Figure  8.  Excel  Spreadsheet  Product 

EMES  Testing  &  Demonstration 

In  August  2003,  the  EVIS  team  conducted  an  end- 
to-end  demonstration  of  the  EMES  system  at  the  Fleet 
METOC  Advance  Concepts  Lab  at  North  Island,  CA. 
Two  sets  of  forecasters  were  tasked  with  providing  a 
mission  effects  matrix  for  a  simulated  strike  planning 
scenario.  One  team  had  use  of  EMES  and  the  other  did 
not. 

Preliminary  analysis  of  the  observations  shows  that 
EMES  not  only  sped  up  the  process,  but  also  helped  the 
forecasters  organize  and  synthesize  the  information  they 
needed  to  provide  to  warfighters. 

During  this  same  period  an  additional 
demonstration  was  conducted  at  the  SPAWAR  System 
Center,  San  Diego,  CA.  The  Real-time  Execution 
Decision  System  (REDS)  was  able  to  extract  METOC 
information  from  EVIS  and  process  it  for  a  simulated 
mission  plan.  REDS  displayed  the  effect  of  METOC  on 
numerous  components  of  a  mission  plan.  REDS  is  an 


example  of  another  user  facing  service  that  can  use  the 
EVIS  data  facing  service  because  of  the  standardization 
of  the  XML  requests. 

Conclusion 

The  EVIS  team  has  developed  a  prototype  system 
that  can  deliver  real-time  threshold  data  and  graphics  via 
a  user-specified  rule  services  system.  The  August 
demonstration  has  shown  that  EVIS  is  moving  in  the 
right  direction,  yet  there  are  several  issues  that  will  need 
further  investigation  and  development.  These  include: 
the  management  of  rules  across  the  Navy  enterprise,  the 
availability  of  METOC  data  for  rule  processing  and  the 
extensibility  of  the  system  for  uses  beyond  thresholding. 

The  EVIS  team  will  continue  to  work  with  users  and 
warfighters  to  help  find  the  correct  solution.  Finally, 
with  the  goal  of  successfully  transitioning  this  future 
naval  capability,  the  team  is  currently  working  closely 
with  the  METOC  organizations  responsible  for  fielding 
forecaster  tools. 
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